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ABSTRACT 



This paper addresses the potential of the National Center 
for Education Statistics (NCES) to measure education reforms in the United 
States through Schools and Staffing Survey (SASS) . How the SASS can measure 
reform, the type of reform it should assess, and the elements of school 
reform that would best serve the needs of state and federal policymakers are 
considered. The first section of this paper describes school reform, suggests 
why it is important to measure it, and describes the challenges and 
appropriateness of using the SASS to measure its progress and effects. 

Section II describes eight reform elements that are proposed as a framework 
for examining reforms that are important to measure. These are: (1) 

governance and organizational infrastructure; (2) classroom instructional 
practices; (3) professional development of teachers; (4) programs and 
educational services for varied populations; (5) family and community 
partnerships; (6) finances and human resources development; (7) educational 
productivity; and (8) technology. Section III examines the extent to which 
the SASS and other large-scale surveys already measure reform, and section IV 
summarizes the analysis and recommends better ways for the SASS to collect 
data to provide a national window on reform. Appendixes A and B summarize the 
framework of school reform elements and provide background information about 
the surveys reviewed. Appendix C lists items from the SASS and other surveys 
that could be used or modified to measure important school reform elements. 
(Contains 51 references.) (SLD) 
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This paper addresses the potential of the National Center for Education Statistics (NCES) to 
measure education reforms in the United States through the Schools and Staffmg Survey (SASS). The 
overarching questions are: How can SASS best measure school reform? Should it measure the 
implementation or the effects of school reform? What are the elements of school reform that would 
best serve the needs of state and federal policymakers? To answer those questions, we describe 
school reform, suggest why it is important to measure, and describe the challenges and 
appropriateness of using SASS to assess its progress and effects. Section II describes eight reform 
elements that we propose as a framework for examining reforms that are important to measure. 
Section HI examines the extent to which SASS and other large-scale surveys already measure reform, 
and Section IV summarizes our analysis and recommends how SASS could better collect data to 
provide a national window on the status and progress of reform. Appendices A and B summarize our 
framework of school reform elements and provide background information about the surveys we 
reviewed. Appendix C lists items from SASS and other surveys that could be used or modified to 
measure important school reform elements. 



I. Defining School Reform 

School reforms are changes occurring in schools and education administrative agencies that 
are designed to improve educational programs or outcomes or to correct institutional problems or 
defects. They include changes made to the programs, processes, and organizational systems where 
teaching and learning occur. According to education historians Tyack and Cuban (1996), reforms are 
either provoked by social or political upheavals or reflect internal improvements that individuals or 
institutions undertake in response to changing circumstances. 

Tyack and Cuban (1996) argue that reforms survive because they adhere to the "pedagogical 
speed limit" and quickly become a familiar part of the landscape and known elements of "real 
school." Reforms that are institutionalized are typically noncontroversial programs and organizational 
add-ons that do not disrupt the status quo. Significantly, they have a following of policy leaders and 
influential educators who support their stability. Once reforms become an accepted part of the 
structure of schooling, they might be criticized, but they are rarely abolished. 

The high visibility of the federal reform policies of the 1990s and questions about their impact 
on districts and schools suggest the need for a nationally-representative data base on reform to guide 
policy making. Such reforms as state academic standards, aligned assessments, and systemic policies 
all indicate a growing need for data on how school and district operations have and will change in 
response to local, district, state, and national policy changes. The SASS surveys of teachers, schools. 



and districts may be adaptable to that task since SASS has already established a baseline of data on 
several key reform themes. 

Accessibility of up-to-date, accurate information about education outcomes has made data an 
essential element of the equation at many points in the policy planning and implementation process 
(Elmore, 1996). Policymakers, impatient with past uneven successes and frequent education policy 
changes, are seeking to ground new education initiatives on more solid evidence of program outcomes 
and student achievement (Odden & Clune, 1995). As analysts and practitioners become increasingly 
proficient in data-based decisionmaking, they become committed to using a respected data source such 
as SASS for periodic progress reporting on implementation. 

Although researchers and policymakers routinely conduct studies to assess the effects of new 
education initiatives and program innovations, it has been difficult to sustain a nationwide data 
collection effort about school change. Many reforms are often short-lived-introduced with great 
fanfare but only partially mq)lemented-and quickly replaced by a new reform before survey 
instruments can be adequately piloted and data collected, cleaned, and analyzed. Other reforms are 
ill-defined or illusive, requiring what Tyack and Cuban (1996) call "careful detective work" to assess 
the actual impact of proposals to inqjrove schools. 

In the early phases of reform it is difficult to know exactly what to track. Tyack and Cuban 
(1996) suggest three reasons why this may be so; (1) the time lag between initiation and 
implementation of a reform; (2) the uneven penetration of reforms in various educational settings and 
communities; and (3) the difference in impact across social groups. In addition, as Baker (1996) and 
Jennings and Stark (1995) point out, educational reform as a political process is always in flux: "What 
is ‘hot’ today is not tomorrow, but it may be back in ten years," Baker observed (1996, p. 33). In 
studying reforms during the 1960s and 1970s, McLaughlin (1990) concentrated on the policy inq)acts 
of the reforms. Retrospectively, she acknowledges that while her research to understand how reform 
occurred concentrated on how policies changed, it was the embedded structures in which teachers and 
schools worked that most influenced change (McLaughlin, 1990, p. 14). 

Reforms often fade for a number of reasons; because they are ill-defined, incompatible with 
ass ump tions about how schools work, or institutionalized and, therefore, they become invisible 
features of the educational landscape. Fluid terminology and education reform concepts make it 
difficult to collect national data about those initiatives that most affect schools, especially in the early 
stages when changes are just beg innin g to take shape. Common understandings of new and modified 
terminology evolve slowly and in concert with reform priorities, posing obvious problems when data 
collection requires a high level of specificity with which to construct reliable instruments. 



Furthermore, as Tyack and Cuban point out, "Major changes have sometimes taken place in relative 
silence. Minor changes, deliberate at first, have often become so common as to be taken for granted 
and not perceived as reforms" (1996, p. 54). 

The instability of many school reforms makes describing and reporting on them a challenge, 
regardless of the data collection method used. Yet reforms are routinely instituted at all levels of 
schooling (classroom, school, district, and state) and in all facets of education (governance, policy, 
instruction, professional development), both systemically and independently. Their prevalence 
provides the oppormnity for SASS to track implementation, stability, and effects at the multiple levels 
and locations at which they occur. Measurement difficulties should not deter researchers from 
monitoring important aspects of school reform through SASS, so we must determine how that 
measurement would best occur. 

In the next sections, we describe general and specific criteria for selecting potential survey 
items for SASS that would track reform. We next distinguish between types of items that measure 
the implementation of school reform and the effect of that reform. Finally, we summarize the current 
SASS coverage and gaps in measuring reform, and then do the same for other large-scale and publicly 
available surveys. Appendix B summarizes the surveys we examined; Appendix C contains items 
from SASS and other surveys that hold potential for measuring reform. 



Measurement Criteria 



Recommendations from Boe (1996), Jennings and Stark (1996), Mullens and O’Brien (1996), 
and Mullens (1995) provided general and specific criteria for selecting or developing SASS survey 
items on school reform. According to these general criteria, survey items should: 

(1) Inform state and local education policy, and, where feasible, be used to inform broad 
national policies (Boe, 1996; Jennings & Stark, 1996; Mullens, 1995) 

(2) Use terminology that is well-defined and commonly understood by the respondent 
populations that participate in SASS (Mullens, 1995) 

(3) Avoid duplicating population estimates in other high quality, large-scale NCES 
surveys such as the Common Core of Data (Mullens & O’Brien, 1996) 

(4) Be measured through sample survey methods that minimize response burden (Mullens 
& O’Brien, 1996) 



(5) Be written at a level of specificity appropriate to the respondent group (Mullens, 
1995) 

From the commissioned SASS papers (Mullens and O’Brien, 1996), we also identified four 
specific criteria for survey items that measure the extent of reform implementation. According to 
these specific criteria, survey items should: 



(1) Capture data on themes that reoccur through the continuing survey cycles of SASS 
and avoid being distracted by politically visible but potentially short-lived initiatives. 

(2) Collect information on the results of reform: the school, classroom, curriculum, and 
instructional processes likely to change as reform is implemented. 

(3) Restrict measurement to reforms that are sufficiently well-institutionalized across the 
country so that their impact can be assessed reliably in a state- or nationally- 
representative sample. 

(4) Use language that is understood widely and descriptive of reforms implemented in 
multiple and diverse contexts. 



Measuring Implementation and Effects of Reform 



We think it is imp ortant to distinguish between items that directly seek information about the 
implementation of school reform and those that seek to understand the ^ects of school reform. 
Responses to the former would provide immediate insights about the extent to which certain reforms 
are or are not in place; responses to the latter would provide information about the effects of school 
reform on, for example, organizational structure, parent and community involvement, and classroom 
instruction. The following question from the Principal Survey of the Classroom Effects of Reform 
(Charting Reform) Survey is useful in tracking the existence or implementation of programs that 
respond to issues important to school reformers and identifies specific restructuring efforts: 



Using the following scale, please indicate the extent to which your school is involved in the following restructuring 
efforts. (1 = Characteristic of most of my school, initiated prior to reform, 2= Characteristic of most of my 
school, initiated since reform, 3=Something that we will be working on more in the next two years, 4= Not a 
priority for the next two years, 5= Not important) 

• Students participate in community-based learning 

• Long-term adult mentors for students 

• Teachers woiic closely with parents and human service professionals to meet student needs 

• School has a systematic program for parent involvement in the academic life of students that goes beyond 
the normal activities of ^A, parents’ night, and attendance at extracurricular events 



• School has formal mechanisms for coordinating with community agencies* for example* offering services 
dealing with child care* drug and alcohol abuse* and parental employment and training* etc. 

• School participates in an external mentoring program* such as "I Have a Dream*" which follows students 
for several years 

• School offers adult education programs and recreational opportunities for the community 

• School has formal parent and community volunteer program 

• School has formal arrangements with local employers to place students in career-ladder jobs during the 
school year* summers, and following high school graduation 

• School has formal arrangements with institutions of higher education to assist students in continuing their 
schooling 



Charting Reform, Principal Survey, 1994 



In comparison, responses to a different sort of question provide information with which to 
measure the effect of school reform. The following question, for example, asks about one type of 
effect resulting from a restructured class schedule. 



Fifty-minute periods were introduced at the beginning of this school year. Now that most of the year has passed, 

please mark how you feel about them: (Strongly disagree. Disagree, Agree, Strongly agree) 

The 50-minute period: 

• Provides greater opportunity for student learning 

• Reduces opportunities for teachers to work together 

• Overall, is better for students 

• Overall* is better to teachers 

Charting Reform, Principal Survey, 1994 

For measurable school reforms, SASS may be a very useful instrument. SASS was first 
administered in 1987-88 to provide data that would inform state and federal decisionmakers and the 
educational research community about public and private elementary and secondary schools. Its 
linked set of surveys and survey processes provide a network of interlocking data sets from different 
organizational elements at the classroom, school, and district levels. The surveys generate recurrent 
information on public and private elementary and secondary schools, teachers, and administrators that 
would be ideal for monitoring school reform or change over time. 

The data collected by the 1993-94 SASS fall into four general categories: 



• Teacher supply, demand, and attrition, with attention to critical shortage areas and the 
policies and practices to meet the demand in those areas 

• The professional characteristics, preparation, and experience of teachers and 
administrators, their perceptions of school conditions, professional responsibilities, 
decision makin g, and condensation 



• The conditions and characteristics of the school as a work and learning place, 
including characteristics of the student body, curriculum, special programs, and 
organizational strucmre 

• The availability of school programs and policies such as English as a second language, 
bilingual education, diagnostic and prescriptive services, and programs for the gifted 
and talented (Mullens & O’Brien, 1996) 

o 

These topics remain an important core of the next SASS, and the survey could provide a 
proper home for items exploring related reform issues. In two separate efforts, experts have 
suggested that NCES would be wise to improve the scope and the usefulness of all data collection on 
school reform efforts (Hoachlander, Griffith, & Ralph, 1996; Mullens & Kasprzyk, 1996). 

Participants in the 1996 NCES seminars on new directions for SASS suggested that SASS investigate 
school reform efforts within broad educational categories at district, school, and teacher levels in four 
distinct dimensions of reform (Mullens & Kasprzyk, 1996): 

• Classroom curriculum and instructional processes 

• Elements of school organization and resource allocation 

• Professional development of teachers 

• The use of technology in classrooms 

Collecting data on specific elements of education reform will establish a baseline for a 
continuing analysis of the evolution of schools, teachers, and smdents. SASS evidence about the 
presence or absence of key feamres of schooling can provide the first large-scale base of information 
on the existence or evolution of education reform. To date, smdies of reform have t 5 qpically relied on 
case smdies and more limited surveys than SASS. A survey data base developed through SASS could 
describe the impact national education reforms have at the school and district levels in ways 
heretofore impossible. Significantly, a SASS data base on reform could also make possible systemic 
smdies on the relationships between educational outcomes and specific reform practices. 



n. Delineating School Reform 



Our review of recent research on education reform catalogued a wide array of topics that have 
been, or are being, actively explored and promulgated by education experts. The topic list below 
places school reforms within the broadened educational context in which they occur. We have 



organized the framework into eight topics that affect student learning through teachers, classrooms, 
and schools. The topics reflect (1) Baker’s (1996) and Boe’s (1996) suggestion that SASS concentrate 
on the changes that occur at the district, school, and teacher level, and (2) other analysts’ emphasis on 
studying reforms that help set high expectations for learning among children and capacity building 
among professionals (Choy, 1996; Stodolsky, 1996). The eight topics are: 

• Governance and organizational infrastructure 

• Classroom instructional practices 

• Professional development of teachers 

• Programs and educational services for varied populations 

• Family and community parmerships 

• Finances and human resource development 

• Educational productivity, and 

• Technology 

This framework is intended to be comprehensive and include the major issues currently being 
advocated. Many of the most visible reforms are relatively new, tried in comparatively few schools 
and districts, and still being defined. Final discourse about which of these reform components SASS 
should track depend on selection criteria that we address in Section m of this paper. This section 
reviews briefly the research underlying each topic. Appendix A summarizes the framework. 



GovernaTife and Organi/ational Infrastructure 

Hannaway and Camoy (1993, p. 232) describe policymakers’ affection for altering the 
governance of schools as a "fatal attraction." These authors note that when schools and society 
appear to be "in trouble," policymakers seek "solutions" by changing the organizational structures of 
schools. The result is that governance has become the major policy instrument of recent reforms, 
offering a smorgasbord of choices for how to organize and manage schools. Our review of the 
research highlighted six clusters of governance and organizational activity: 



Policy makin g structures 
Organizational arrangements of schools 
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• Staffing and managing of state and local education agencies and schools 

• Organizing uses of leaming/teaching time in schools (see also classroom instructional 
practices) 

• Instimtional capacity building for managers and school leaders 

• Organizational influences of the courts 

New policy making strucmres for guiding schools have emerged since the 1960s when the 
federal government began to insist on equal access to good schools for minority and poor children. 
Federal activism began with the government’s oversight of its investments in civil rights and stepped 
up with its support for curriculum innovation and services to students with special needs resulting 
from poverty, limited-English speaking ability, or disability (Odden, 1991). Eventually the federal 
government tightened its program monitoring and reporting requirements, and state and local 
governing agencies adapted their policies to meet evolving federal standards. With each new program 
strategy and funding cycle, both federal and state government officials sought to shape how districts 
and schools administered supplementary funds. Federal and state agreements on policy 
implementation escalated the policy making at every layer in the governance structure, strengthening 
the influence over school policy making by legislatures, state and local school boards, and various 
interest groups. Moreover, new stakeholders— business alliances, political groups, and collaboratives— 
have become more influential partners in school policy making (Fuhrman, Clune, & Elmore, 1988, in 
Odden 1991). Evolving policy making strucmres also promote staffing and management autonomy 
with incentives and sanctions to improve smdent and school accountability for educational outcomes 
(Fuhrman & O’Day, 1996). Inducements such as regulatory flexibility-especially when combined 
with adequate professional development, collaboration, and continual retraining-have also changed 
the policy making strucmres that influence school improvements (Wohlstetter & Mohrman, 1994). 

Alternative organizational arrangements of schools grew out of the lessons learned from the 
effective schools movement of the 1970s. Emerging private sector management concepts contributed 
focused ideas about how schools can be better organized and more efficiently managed (Odden & 
Odden, 1995). Some districts encouraged dividing schools with large populations into small, 
personalized groups taught by teaching teams in "houses" or "cadres." Others altered traditionally 
graded elementary and junior high schools into developmentally responsive primary (for example, 
multi-graded kindergarten through second or third grades), upper elementary, and middle school 
programs to reflect emerging research on the specialized educational needs of children at different 
phases of development. State legislamres established laws promoting publicly-funded alternative 
strucmres such as magnet programs, schools-within-schools, or private or quasi-private schools 
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chartered by groups of parents or teachers to create ways for parents to increase their school choices 
(Hannaway & Camoy, 1993). Such laws allow students to (a) move within and between districts to 
attend schools; (b) take college or university courses; (c) enroll in residential and special high schools 
for academically talented smdents; and (d) participate in academies and special focus schools for 
smdents who need special help or who have talents that would benefit from intensive training (Fossey, 
1992). 



The federal government encouraged "systemic" staffing and management reforms to bring 
increased coherence to how federal, state, and local education agencies use funds to improve school 
efficiency and responsiveness (Smith & O’Day, 1991). The 1994 Elementary and Secondary 
Education Act (ESEA) reauthorization. National Science Foundation funds, and Goals 2000 encourage 
states to re-examine policies on school and district organization, curriculum and evaluation, teacher 
preparation, licensure, and retraining (Massell, Kirst, & Hoppe, 1996). Systemic reforms include 
decentralization policies that replace regulation with flexibility and emphasize site-based management 
that gives principals, staffs, and community decision-making teams greater autonomy over the day-to- 
day decisions that affect smdent learning (Wohlstetter & Mohrman, 1994). The premise of these 
reforms is that deregulation and program flexibility can lead to more effective classroom and school 
instruction that (1) is content-focused, (2) is well-planned and organized, and (3) emphasizes smdent 
mastery of rigorous curriculum content (Corcoran & Wilson, 1986; Purkey & Smith, 1983), even in 
schools with high concentrations of low income and educationally disadvantaged smdents (Odden & 
Odden, 1995). 

Recent governance reforms have even examined traditional time constraints that rule the 
school day, the school year, and teachers’ use of time for teaching and planning, finding that 
traditionally structured schedules are the "unacknowledged design flaw in American schools" 

(National Education Commission on Time and Learning, 1994). Despite efforts to make substantial 
adjustments, however, only marg inal changes occur in the quality and quantity of smdents’ time for 
learning or in how teachers allocate their own professional time (Adelman, Haslam, & Pringle, 1995). 
Smdies of the effects of operating schools year-round also fail to provide conclusive information about 
the relative merits of changing how schools distribute time across the 12-month calendar year 
(Pechman, O’Brien, & Mullens, 1995). This suggests the need for an information base on the (1) 
amounts and ways teachers use time while "on the clock" in school and on unpaid, personal time; (2) 
the ways smdent time is allocated in the day, the week, and the year; (3) the extent to which 
communities experiment with alternative uses of the school building during low-use periods 
throughout the year; and (4) the effects on smdent learning, especially achievement among children 
with different learning needs, and teachers’ beliefs about their working conditions. 



Institutional capacity building is necessary to prepare school personnel at every point in the 
system— from school to school board— for new leadership roles and different kinds of managerial 
responsibilities. If schools are to become high performance organizations, managed by teachers and 
principals, all the players within and surrounding them-state and district managers, staffs, and 
community members— will need to develop a common vision that significantly alters current 
expectations about the goals of schools and the means to accomplish those goals. Moreover, for 
decentralized management to be effective, there must be tight policy coordination among the three 
levels of governance to which schools are accountable, and adequate org anizati onal capacity building 
through technical assistance, professional development, and resources (GAO, 1993). These 
adjustments are large in scale, and, thus far, the evidence suggests that the likelihood of stabilizing 
such dramatic organizational reforms remains an open question. According to Wohlstetter & 
Mohrman, "there is scant evidence that schools get better just because decisions are made by those 
closer to the classroom" (1994, p. 1). 

Finally, the courts are expected to have a substantial effect on American schooling as school 
reforms are designed to address equity issues. Odden and Odden (1995) speculate that "the bold 
education reforms of the 1990s could very well stimulate a wide array of new federal court decisions 
on education policy," and that "the courts could become the surprise parmer of education reform," 
requiring programs that eliminate educational differences across racial lines and equalize funding (p. 
325). Four organizational areas where the courts are most likely to act are: (1) school funding and 
resources allocation; (2) desegregation and educational equity; (3) racially or ethnically related 
differences in students’ achievement of educational standards, as measured by new assessments; and 
(4) private and parochial school programs, including the uses of vouchers and charters to support non- 
public school programs. 

Governance and organizational infrastructure are lively arenas of policy making reform, but 
many of the initiatives receiving the greatest policy attention are relatively new and still developin g 
Interest in collecting data about these reforms through SASS must be tempered by the uncertainty 
about which components will become long-term features of schools and educational organizations. 



Classroom Instructional Practices 



If improved outcomes are the evidence that school reform is benefiting students, measuring 
the curriculum enacted in classrooms and the instructional approaches selected by teachers are the best 
information sources about the progress of school reform. Organizational structures can shift and 
professional development in reform methods can occur, but no reform will have been achieved if 



students’ learning activities in school remain unchanged. Mullens (1995) and Mullens and Leighton 
(1996) reviewed the evidence of reforms in the broad realm of classroom instructional process and 
identified four dimensions that have potential value for understanding the evolution of professional 
practices in classrooms and the oppormnity of students to learn; 

• Conditions and context of learning 

• Course content and emphasis 

• Instructional activities of teachers and students 

• Materials 

The current reform movement appears to be emphasizing new models of instruction that 
engage students actively in learning higher-order thinking skills. Past emphasis on "basic" skills, 
minimum competencies, and passive drill and practice teaching has shifted toward high expectations 
for all students to develop proficiency in problem-centered and rigorous academic courses. 

Systemic reforms assume that the intended curriculum is set at the district level and is 
constant within classrooms and across contexts within the district. While a curriculum emphasizing 
problem solving, reasoning, and long-term projects may be common within a school or district, the 
instructional pedagogy to achieve that curriculum may differ across classrooms (Stodolsky, 1996). 
High-quality instruction also requires adequate educational resources, including physical materials and 
technology that work in tandem with skilled pedagogy (Corcoran & Goertz, 1995, among others). 
Adequacy of resources is a cross-cutting theme central to high-quality classroom instructional practice 
and several other dimensions in this taxonomy. 

These dimensions are potential priority areas for SASS assessment because they are strongly 
related to student achievement and amenable to policy making. Collecting information about reform 
effects on the teaching that occurs behind the classroom door is an elusive base of information that 
researchers are still learning about (Porter & Smithson, 1995). Current and recent NCES-funded 
projects explore data collection about curriculum and classroom pedagogy within one content area and 
a limited range of grade levels (Mullens & Leighton, 1996). A challenge for SASS will be to select 
those aspects of classroom activities that can be adequately captured in a periodic survey, conducted 
across all subjects and grades. 



Professional Development of Teachers 



In a recent review, Mullens, Leighton, LaGuarda, and O’Brien (1996) established the 
following taxonomy of measurable elements of professional development: 

• Design of professional development: the connection with broad school improvement 
goals and responsiveness to teacher and organizational needs 

• Delivery of the professional development: the options for teachers, types and duration 
of activities, and uses of available professional resources 

• Content of the professional development: the subject matter, instructional strategies, 
and organizational skills 

• Context in which professional development occurs: the institutional support, financing, 
and school culture 

• Outcomes of development activities, including changes in teachers’ 
knowledge/attimdes and classroom practices, in schools, and in students 

Reformers are calling on teachers to make radical changes in their curriculum and 
instructional practices and professional development is the proposed vehicle (Corcoran & Goertz, 
1995). Professional development entails increasing the ability of teachers and the supportive 
institutions around them to work more effectively, expanding the substantive knowledge of what is to 
be taught, and providing better pedagogical tools to ensure that all smdents accomplish the goals set 
by their teachers and communities. 

Cohen (1995) and Corcoran and Goertz (1995) (see also Fuhrman & O’Day, 1996) suggest 
that building professional capacity to meet emerging standards requires changing at least two aspects 
of instruction. First, teachers need to improve their knowledge of the content they teach and their 
knowledge of content-related pedagogy. Second, teachers must relinquish low expectations for 
smdents with special educational or language needs and from poor and minority families. 

Data about the professional development of teachers provides the basis for charting and 
understanding the professional capacity building in schools, its prevalence, and its change over time. 
Collecting such data assumes that the goal of professional development is to in^rove the quality of 
teaching by improving teachers’ skills in assessment, classroom management, pedagogy, and content 
expertise. Indicators about the content and quality of teachers’ professional advancement activities 
show the degree to which the capacity-building initiatives that schools and districts are undertaking 
amidst reform occur in the areas of instruction that researchers advocate. 



Prnprams and Educational Services for Varied Populations 



Social change will place new pressure on schools to provide all students with expanded school 
services. The changing needs of students in public and private schools will require systems to address 
intense stress fectors in smdents’ lives. Poverty, unstable family strucmres, and increasing numbers 
of smdents with special needs make clear that schools will be called on to cope with the resulting 
challenges. 

SASS can offer a descriptive data base about the changing services that schools are providing. 
Data are needed in six categories: 

• Services for smdents with special educational needs, learning disabilities, and learning 
abilities 

• Services for limited-English speaking smdents 

• Services for youth and families 

• Services for individual smdents at risk of educational failure 

• Cross-culmral programs to serve various immigrant populations 

• Supplementary educational and recreational services (including preschool and before 
and after-school programs) 

During the past several decades, educators separated special services for high needs smdents 
into remedial or supplementary programs. Unformnately, this approach unnecessarily stigmatized 
smdents and diluted rather than enhanced their opportunities for learning (Milsap, Moss, & Gamse, 
1993). As a result, current reforms encourage the "inclusion" of at-risk smdents in the same 
programs as their age peers to reduce isolation and increase the substantive quality of their 
opportunities for learning. Instruction for all children is expected to focus on solving complex, 
meaningful problems that connect "everyday" and "school" knowledge; embed basic skills instruction 
in context; maifp connections between smdents’ prior knowledge and their culmre; build on the social 
namre of learning through small and whole group discussions; and focus on developing thinking skills 
from the earliest grades. The 1994 Improving America’s Schools Act (lASA) deliberately encourages 
a "school wide" approach to serving smdents at risk, and, in time, fumre special services and 
resources may be wholly integrated within mainstream academic programs. 
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Data collection should track information on school trends in serving at-risk students; 
classroom strategies and school district supplementary services for high-risk smdents; and services for 
smdents and families at risk, including preschool programs, extended school-day activities, and 
recreation programs. 



Family and Conunimitv Partnerships 

Researchers have documented the strong connection between parent and community 
participation in schools and higher achievement among smdents. Regardless of smdent age, family 
income, or parent education, family involvement in schools seems to increase the likelihood of 
smdents’ academic success (U.S. Department of Education, 1994, September). National (Epstein, 
1992) and international smdies (Stevenson & Stigler, 1992) indicate that parent involvement and 
smdent motivation improve when schools welcome parents and reach out to help parents improve 
children’s learning at home. Epstein’s research (1995; Epstein & Hollifield, 1996) establishes a 
concepmal framework for understanding the expanded, two-way context in which parents and 
communities can and need to support schools. Those elements include: 

• Parent education and skills development 

• Communicating among families, schools, and communities 

• Volunteering in schools 

• Participating in decision making 

• School, business, governmental, and community collaborations 

The evolving concept of family and community partnerships draws together three overlapping 
"spheres of influence" on children-families, schools, and communities-that influence their learning 
and development (Epstein, 1995). These parmerships involve schools and community members 
collaborating in large and small ways on behalf of children. Schools help parents develop their skills 
as children’s "first teachers;" parents and community members volunteer in classrooms as assistants 
and teachers or mentors. Communication occurs through various means, including newsletters, cable 
television broadcasts, and written "compacts" that define shared expectations and responsibilities 
among schools and parents. Schools formalize new decision-making roles for parents that routinely 
involve parents and community representatives in pl annin g and program implementation. Community 
groups devise collaborations among businesses; social services agencies; and universities, colleges, 
and community colleges to lend support to smdents and families (Epstein, 1992). 



The federal government under Title I of IAS A is encouraging states, districts, and schools to 
write constituency-based partnerships plans that describe how parents and other community 
representatives can become involved in designing and implementing continuous school improvements. 
Schools with Title I programs must establish "compacts" with parents that detail school and home 
responsibilities for supporting students. Other IAS A components encourage schools to develop 
linkages with health and social services agency linkages and business partnerships to advance school- 
to-work alliances. 

We can expect expanded programs to help parents support their children’s learning at home 
(LaGuarda, Funkhouser, Stief, Gonzales, Goldstein, & Murphy, 1996). SASS can be a resource to 
determine the extent of these practices and to assess their impact in varied school contexts. 



Finanrp<i and Human Resources Development 

Education reformers are likely to call for redesigned finance systems and new strategies for 
identifying, recruiting, and conqjensating school staffs. Three priority areas have emerged: 

• Finance strategies, including changes in federal, state, and local finance systems 

• Equity attained by expanding programs and increasing resources to prevent school 
failure and enhance school success 

• New salary structures, policies for recruitment, compensation, and certification 

Finance and resource data collection involve the scope of public school funding: 
progra mmat ic, h uman , and capital resources, and the mechanisms to account for per pupil spending 
(Chambers, 1996). As education funding increases, the amount states and districts allocate varies 
across school districts within states, and it varies unequally. Site-oriented fiscal policy initiatives such 
as charter schools, public choice, vouchers, private contracting, and school-site budget management 
influence the equitability of resources distribution (Odden, 1990). In addition, if decentralized 
management places greater fiscal and administrative burdens on schools and local districts, there will 
be further need for comparative finance and resource data. Legislatures and local school districts are 
likely to call for data they can use to identify new strategies for equalizing school funding and to set 
equity targets for distributing state and federal aid (Odden & Odden, 1995). 

Teacher conqjensation policy, incentive systems, and certification programs are three resource 
issues likely to increase in importance. Massell et al. (1996) spell out five domains of compensation 
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in which states are developing new policies; salaries and incentives, preservice training, inservice 
training, certification, and evaluation. States continue to experiment with teacher incentive systems. 
They are seeking to incorporate principles of skill-based pay, school-based performance awards, and 
pay for the specific job (Kelley & Odden, 1995), making school-based incentive programs such as 
those in South Carolina, Kentucky, and Texas may become more widespread (Massell et al., 1996). 

Certification programs are becoming more complex as states add new dimensions or 
requirements to traditional certification. By 1990, 30 states mandated some form of testing as part of 
their certification requirement; life-time licensure had been virtually abolished; and recertification 
required teaching experience and continued formal training. Finally, more states and districts are 
compensating teachers for participating successfully in national or state board certification programs, 
with interest growing in the certification program offered by the National Board for Professional 
Teaching Standards (Massell et al., 1996). 



Educational Productivitv 

Educational productivity refers to educational results, usually indicated by important outcomes 
such as; the number and competence of high school graduates; overall student achievement; the 
number of students enrolling in higher education and postsecondary career development programs; 
achievement in high poverty schools; and the performance gap between minority and white students 
(Odden & Clune, 1995). Attention to productivity is consistent with the results orientation advocated 
by educational reformers (Smith & O’Day, 1991). Reformers advocate that schools set new, more 
ambitious expectations for students, including; rigorous "standards" that define a broader and deeper 
core of content expectations; pedagogy that emphasizes group work, discussion and writing, and 
discourse and debate (Fuhrman & O’ Day, 1996); student assessment as a component of instruction 
(Boe, 1996; Chambers, 1996); indicators of school-level accountability and the rewards and sanctions 
that motivate educational productivity (Odden & Clune, 1995). Research suggests four aspects of 
educational productivity can inform our understanding of reform; 

• Standards 

• Student assessment and achievement 

• School accountability 

• Rewards, sanctions, and competition to motivate achievement 



New approaches to productivity analysis reflect changing expectations for what schools should 
be accomplishing. "Standards" have become an important component of instructional reform. The 
initial conceptualization of systemic reforms in the early 1990s made content and performance 
standards (the material smdents could demonstrate "they know and can do" as a result of a rigorous 
academic program) the centerpieces of policies for raising expectations for learning (Fuhrman, 1993; 
Smith & O’Day, 1991). 

How smdent achievement is measured is an important and changing component of the 
standards-based reforms initiatives. The reauthorized Elementary and Secondary Education Act 
requires that all states receiving federal education funding test students at least once during the early 
elementary, middle school, and high school years in reading or language arts and mathematics. States 
and LEAs increasingly use a variety of standardized and teacher-made tests to monitor local 
performance, report outcomes for accountability, and provide evidence that Title I schools are 
achieving "adequate yearly" academic progress. 

Testing is also changing in type and purpose. Policymakers are now looking toward tests 
referenced to specific standards or objectives that measure students’ extended performances via short 
tasks, essays, and individual and group "projects." Some states are developing combination 
assessment systems that report both norm-referenced and criterion-based performance information to 
meet both state and federal expectations (Massell et al., 1996). States such as Arizona, California, 
and Vermont that took the lead in developing ambitious performance tests in the early 1990s 
encountered considerable political opposition and are again rethinking their testing programs. Still 
other states (among them Connecticut, Kentucky, Maryland, New York, and Massachusetts) continue 
to press forward with innovative testing on variously modified time schedules (Blank, Pechman, & 
Goldstein, forthcoming). SASS data on types of smdent assessments will aid policymakers in their 
efforts to understand the effects of the changes they make. 

Indicators of school accountability and smdent progress include the number of academic 
courses required for graduation; postsecondary education participation; minority participation in 
postsecondary education programs; and the achievement of smdents on national and international tests 
(Massell et al., 1996; Odden & Clune, 1995). Rewards and sanctions are being explored as 
mechanisms for ensuring an accountability and outcomes orientation. "In a perfect world," writes 
Cohen (1995), "one would not need to discuss rewards and penalties," but rewards and penalties are 
mechanisms used increasingly to signal what is most valued and to recognize those who achieve the 
valued goals. Questions about what rewards and penalties are best suited to inqiroving smdent 
achievement, and who should be rewarded, have become inqiortant aspects of current reforms 
(Fuhrman & O’Day, 1996). 



Technology 



Technology is a critical resource for restructuring school organization, management, teaching 
and learning, and evaluation. David (1991) observes that technology can transform what 
organizations look like, how they function, and how people interact within them. Introducing 
technology into schools connects teachers, students, and managers to vast information resources, and 
provides tools for changing the ways schools accomplish their goals, including using computers, 
distance learning mechanisms, and various media and technological tools and instruments used in all 
content areas. 

Fulton (1996) states that educational use of technology acconqjlishes three goals: it (1) 
enhances instruction by providing teachers with new ways of teaching; (2) results in greater teacher 
productivity; and (3) supports teacher learning. To these we add a fourth: educational use of 
technology contributes to more efficient and responsive management decision making by organizing 
the flow of resources into classrooms; planning and scheduling classes, teams, and activities; and 
collecting, evaluating, and using data. 

Fulton also points out that, to date, the primary information gathered by SASS about 
technology are counts of computers available in schools. This is only one piece of a more complex 
puzzle. She concludes that data collection should also define the effect of state policies on access to 
technology; how computers are acmally used by teachers and students; and their impact on teaching 
and learning. We suggest incorporating these themes into five broad areas that can yield information 
about how technology supports student learning by streamlining management and reforming how 
teachers and students work in schools: 

• Developing and using technology-based information systems in school and district 
management and communication 

• Improving instruction and opportunities for all children, including teachers’ use of 
technology in the classroom 

• Creating professional development opportunities for teachers, classroom assistants, 
and school- and agency-level managers 

• Establishing and maintainin g program and student accountability 

• Organizing school operations, e.g., transportation systems, scheduling of students and 
comrses, scheduling staff 



ni. Measuring School Reform 



Data on School Reform from the Most Recent SASS 

To assess the potential for documenting reform through SASS, we first reviewed items in the 
1993-94 SASS to identify (1) existing items that address reform themes and (2) gaps in reform 
measurement in the current SASS. We then reviewed instruments used in recent large-scale surveys 
of reform to identify other items that could be adapted for SASS. 

SASS already measures many aspects of reform topics in our framework. The largest number 
of SASS items addressing reform are in governance and infrastructure; the delivery of professional 
development; programs and services for varied populations; and career patterns, mobility, and 
compensation. There are fewer items on classroom instructional practices; certain dimensions of 
professional development among teachers; family and community partnerships; educational 
productivity; and technology. No SASS items document school finance reform, but there are SASS 
items on labor markets, compensation, and recruitment. 

SASS items for each of the eight reform areas are examined in further detail below. 

Governance and organizational infrastructure. SASS currently has a substantial number of 
questions about governance and organizational infrastructure (see Appendix Cl); most focus on 
policy-making structures, such as the item below. They target reforms dealing with school-based 
management, teacher authority and autonomy, and the perception of decision-making power within a 
school. However, SASS currently collects no information on waivers or the flexibility of rules. 

25. Using the scale 0-5, indicate how much ACTUAL influence you think each group or person (State 

Department of Education; School district staff; School board; Goveming/Diocesan board; 

Principal/School head; Teachers; Curriculum specialists; Library media specialists/Librarians; Parent 

association) has on decisions concerning the following activities: 

a. establishing curriculum 

b. hiring new full-time teachers 

c. setting discipline policy 

d. deciding how the school budget will be spent 

e. determining content of in-service programs 

f. evaluating teachers 

SASS Public School Principal Quesnonnaire^ , 1993-94 



’ A similar item appears in the Public School Teacher Questionnaire (#44) and the Private School 
Teacher Questionnaire (#44). 



SASS also includes a number of items regarding the organizational arrangements of schools, 
asking questions about the existence of magnet programs, vocational programs, and early childhood 
education programs, as well as seeking classification of school type and class type. One of these 
SASS items-the item below on tech-prep programs-has been criticized for not being specific enough 
in its definition of such programs (Choy, 1996). The item defines tech-prep broadly and omits a 
unique and defining aspect of such programs. The resulting data may overestimate the prevalence of 
such programs since "almost any school with a vocational program could respond affirmatively to this 
question. " 



29c. Does this school have a "Tech-prep" program, i.e., vocational technical instruction in the last two years 
of high school designed to prepare students for two years of vocational instruction at the postsecondary 
level? 

SASS Public School Questionnaire, 1993-94 



SASS has items that collect some data on specialized academies, magnet programs, and home 
schooling (see Appendix Cl). These items could be modified to generate more detail, and expanded 
to include other alternative organizational arrangements such as year-round schooling, charters, 
vouchers, and schools within schools. 



The SASS surveys also contain a few items regarding the availability of medical services, 
alternative scheduling, and uses of leaming/teaching time. Some SASS items also explore an 
organization’s capacity to build and sustain the ability to respond appropriately to social and 
organizational demands (see Appendix Cl). No items seek information about the organizational 
influence of the courts. 



Classroom Instructional Practices. SASS currently asks a limited number of questions that 
measure reform in how instruction is delivered, such as the items below. 

9. Rate the adequacy of the entire [library media center’s resources] collection to meet the needs of multi- 
cultural education. 

15. Does this school practice distance learning? For example, are lessons taught via television, satellite, or 
computer network? 

SASS Public School Library Media Center Questionnaire, 1993-94 

Sonle of the instructional practice items recommended in an earlier paper (Mullens, 1995) were 
included in the 1994-95 Teacher Followup Survey. An expanded survey on the instructional practices 
used in 8- 10th grade mathematics classes will be pilot tested in 1997 and should be available later for 
wider use. These items are contained in Appendix C2. 



Professional development of teachers. SASS asks a few fairly comprehensive questions about 
teachers’ and librarians’ experience with the design, delivery, content, context, and outcomes of 
professional development (see Appendix C3). The following items, for example, ask about delivery 
and content of professional development: 

30. Since the end of last school year, in which of these activities related to teaching have you participated? 

1 . SCHOOL DISTRICT sponsored workshops or in-service programs 

2. SCHOOL sponsored workshops of in-service programs 

3. University extension or adult education courses 

4. College courses in your subject field 

5. Professional growth activities sponsored by professional associations 

6. Committee to integrate academic skills into the vocational curriculum 

7. Other curriculum committee 

8. Committee on selecting textbooks or materials 

0. None of the above 

31. Since the end of last school year, have you participated in any in-service or professional development 
programs which focused on the following topics? 

a. Uses of educational technology for instruction (e.g.. use of computer, satellite learning) 

b. Methods of teaching your subject field 

c. In-depth study in your subject field 

d. Student assessment (e.g.. methods of testing, evaluation, performance assessment) 

e. Cooperative learning in the classroom 

SASS Public School Teacher Questionnaire, 1993-94 

Two previous papers (Gilford, 1996; Mullens, Leighton, Laguarda, & O’Brien, 1996) recommended 
expanding professional development items; those recommendations are currently being considered by 
NCES. 



Programs and educational services for varied populations. Seven items from the 1993-94 
SASS questionnaires address the existence of programs and services for varied populations (see 
Appendix C4). For example, this SASS item may show the effect of reform measures when tracked 
over time. 

22. Please indicate whether each of the following programs or services is currently available at this school 
either during or outside of regular school hours and regardless of funding source. 

a. Remedial reading 

b. Remedial mathematics 

c. Programs for students with disabilities 

d. Programs for the gifted and talented 

e. Extended day or before-school or after-school day care programs 

f. English as a Second Language 

g. Bilingual education 

h. Diagnostic and prescriptive services 

i. Medical health care services 

SASS Public School Questionnaire, 1993-94 
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SASS data collection in this area includes items that measure the existence and availability of 
programs and services for varied populations (Appendix C4). 

Family and community partnerships. Among the 1993-94 SASS questionnaires, six questions 
address fami ly and community paitnerships, and a smaller number seek information about school 
reform as it relates to family and community paitnerships (see Appendix C5). The Library Media 
Center questionnaires also include items that explore reform in the areas of parenting, learning at 
home, volunteering, and communicating with families and communities. Some of the items about 
decision-making strucmres (e.g., SASS Public School Questionnaire 33 a-b. Appendix C5) ask 
whether parents are included and the types of activities these structures address. SASS does not 
currently address schools’ collaboration with local business, governmental, and community 
organizations. 

Finances and human resources allocation. Three items in the Teacher Demand and Shortage 
Questionnaire for Public School Districts and the Private School Questionnaire, such as the one 
below, seek information about pay incentives. 

53a. Does this school (or an organization with which it is affiliated) use any of the pay incentives listed above 
[cash bonus, different step on the salary schedule, other salary increases] to recruit or retain teachers to 
teach in fields of shortage? 

SASS Private School Questionnaire, 1993-94 

SASS also has a series of items that collect data on salary schedules, compensation, and retirement 
plans (Appendix C6). There are no items that collect data on finance strategies, equity, or 
equalization issues. 

Educational productivity. SASS currently collects information about student requirements for 
graduation, school graduation rates, and rates of student applications to college (see Appendix Cl). 
SASS does not seek information on smdent assessment and achievement, rewards, sanctions, and 
competition to motivate achievement. 

Technology. School reforms in technology, like programs and services for varied 
populations, can initially be measured by learning about the existence and availability of 
technologically advanced materials (Appendix C8). SASS has several questions in the Library Media 
Center Questionnaires on the availability of technology. An exanq)le follows; 
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Does this SCHOOL have the following equipment or services - 



a. Cable television? 

b. Broadcast television? 

c. Closed circuit television? 

d. Satellite dish? 



SASS Public School Library Media Center Questionnaire, 1993-94 

The SASS teacher surveys also ask about professional development for using educational 
technology: 

31 . Since the end of last school year, have you participated in any in-service or professional development 
programs which focused on the following topics? 

a. Uses of educational technology for instruction (e.g., use of computer, satellite learning) 

SASS Public School Teacher Questionnaire. 1993-94 

To learn about technology’s impact on school reform, data are needed that assess the use of 
technology in tr ans forming instruction, increasing teacher productivity, or supporting teacher 
learning. Currently SASS items on technology focus only on availability and professional 
development. Other papers produced for NCES, most notably Fulton (1996), also recommend 
expanding the number of items on the uses of school technology. 



Data on School Reform from Other Surveys 

To analyze how data about school reform have been collected through other surveys, we 
culled items from a range of national, state, and university sources. We examined more than 25 
surveys; only 17 were appropriate for our purposes. We sorted items by the reform elements they 
addressed, then compared stems, response options, and formats. We found substantial duplication 
among surveys; for instance, several surveys use items that are very similar to SASS items in areas 
such as perceptions of decision making power within schools or the existence of programs for special 
populations. 

Many of the existing survey items on reform are perception questions, subject to types of 
response bias that limit accuracy and reliability. Other items are more descriptive, showing the 
outcomes of reforms in more measurable terms, such as the extent of teachers’ knowledge and use of 
standards. There were also major gaps in the collection, with no items addressing some of the 
framework elements. Some simvey items cover more than one element and sometimes several 



elements are addressed within a single item. The items included below are examples of the best items 
currently available. 

Governance and organizational infrastructure. In the surveys examined for this study, the 
issues of policy making structures, staffing and management, and uses of time are covered more 
thoroughly than the issues of organizational arrangements of schools and court influences on school 
organization (see Appendix Cl). Seventeen survey items collect information on policy making 
structures, with most items soliciting teacher and principal perceptions about influence and control. 

As mentioned earlier, several items appear to be modeled after SASS items. For example, variations 
of the following SASS item appear in the National Education Longitudinal Study of 1988 (NELS), the 
National Assessment of Educational Progress (NAEP), Charting Reform, Reform Up Close, and 
Prospects: 

44. Using the scale 0-5, how much acmal influence do you think teachers have over school policy in the 

following areas: 

a. setting discipline policy 

b. determining the content of in-service programs 

c. hiring new full-time teachers 

d. deciding how the school budget will be spent 

e. evaluating teachers 

f. establishing curriculum 

SASS Public School Teacher Questionnaire 1993-94 

Other surveys address general staffing and management patterns and the use of specialists or 
aides to augment their teaching staff. NAEP, for example, addresses these staffing arrangements 
through two questions below: 

20 ./21. Is there a curriculum specialist available to help or advise you in each of the following areas (Yes, No)? 

• reading 

• mathematics 

National Assessment of Educational Progress Reading and Mathematics Teacher Surveys 

22. How often do you usually have instructional aides or volunteers to assist you in your classroom (Every 

day. several times a week, once a week, less than once a week, never)? 

National Assessment of Educational Progress Teacher Survey 

Other surveys also concentrate on teacher uses of time, with eight items focusing on this 
topic. An item from the Reform Up Close survey exemplifies the type of data collected in such 
items. 
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During regular school hours, about how many hours per week do you have free for lesson planning and 
class preparation? 



Reform Up Close, 1994 

As states, districts, and schools enact changes to their governance and organizational 
structures, some encounter various types of "roadblocks” or barriers that may prevent changes from 
having their desired effects. The following item attempts to identify these barriers, and in doing so 
collects information on many of the governance subthemes and other reform elements. 



5. Listed below are several factors which could be considered "roadblocks" preventing principals from 
doing the job they would like to do. Please check your response (not a factor, somewhat a factor, 
serious factor). 

• Collective bargaining agreement 

• Poor communication from central and district offices 

• Inability to obtain sufficient funding 

• Inability to provide time for teacher planning or professional development 

• Lack of district-wide flexibility 

• State or Federal mandates (desegregation, special education, bilingual education, etc.) 

• Lack of recognition/reward for principals 

• Resistance to change by staff 

• Standardized testing practices 

• Difficulty removing poor teachers 

• Teacher mmover 

• Time required to administer/supervise extracurricular activities 

• Time taken by administrative detail at expense of more important matters 

Charting Reform, Principal Survey, 1994 



A few items address issues of school organizational arrangements (Appendix Cl), three of 
them focusing on restrucmring efforts (schools-within-schools, interdisciplinary teams, extended 
school days). 

Classroom instructional practices. A prior study (Mullens, 1995) analyzed existing surveys 
for items in this area and recommended a number of survey items for SASS. Most were field-tested 
and used in the 1994-95 Teacher Followup Survey; an expanded set of items will be piloted in an 
NCES project during 1997. Appendix C2 displays the items from this project. 

Professional development of teachers. Two previous studies (Gilford, 1996; Mullens, 
Leighton, Laguarda, & O’Brien, 1996) addressed SASS professional development data collection. 
Both studies recommended potential items for inclusion in the next SASS, and these are shown in 
Appendix C3. These items have not yet been field tested. 



Programs and educational services for varied populations. We identified eight survey items 
in this area. Most focus on services for students with special educational needs or services for 
students with limited English proficiency. Two cross-cutting items address services for youth and 
families; one of these also solicits information on supplementary educational and recreational services. 
Most of the items that collect data in this area are similar to those in SASS surveys, such as the two 
shown below from the NAEP teacher surveys. 

24.-30. Approximately what percentage of students in your school receives the following services? 

• Subsidized school lunch and/or nutrition program 

• Remedial reading instruction 

• Remedial mathematics instruction 

• Bilingual education 

• English-as-a-second language (not in a bilingual education program) 

• Special education for handicapped students 

• Gifted and talented education 

33.-41. Are any of the following policies or programs in effect in your school this year? 

• Before- or after-school remedial instructional program 

• Before- or after-school instructional enrichment program 

• Summer-school program 

• Full-day kindergarten 

• Pre-school program 

• Before- or after-school child-care program 

National Assessment of Educational Progress, 1992 

Only one non-SASS item (Appendix C4) could be construed to ask about services for smdents 
in severe risk simations; we found no items that collect data on cross-cultural programs to serve 
smdents from immigrant families. 

Most of the items in this category collect information about the existence and availability of 
programs for varied populations. They do not provide detailed information about the characteristics 
of such educational services or school strategies to prepare varied populations to achieve high 
academic standards within mainstreamed classrooms. 

Family and Community Partnerships. This element of reform is covered extensively in other 
surveys (see Appendix C5), primarily through the research of the Center on Families, Communities, 
Schools, and Children’s Learnin g (Epstein & Salinas, 1993) and recent Fast Response Surveys from 
NCES that focus on education reform and family-school partnerships. Most of these items are 
couched in terms of traditional parent roles, such as attending teacher association meetings, parent- 
teacher conferences, and attending or chaperoning school events. 



Some items cut across the reform themes identified in our framework, addressing 
communication with families and communities and volunteering in the schools. Several items listed in 
the framework under Governance and Organizational Infrastructure section also address parent 
involvement in decision-making structures. Few survey items focus on parent education, skills 
development, and support for developing parents’ skills. We located a single item that touched on 
community collaboration. 



The following is an example of a cross-cutting item that addresses communication, parent 
involvement in decision making, and volunteering in the schools. 

6. For each area of parental involvement below, indicate to what extent you have engaged in the activity 

with parents of your students, and indicate the extent to which you need information on these activities to 
involve parents in student learning, (yes/no) 

• Providing information or advice to parents to help them create supportive learning 
environments at home (e.g., shared parent-child activities, periodic review of homework folders 
by parents, etc.) 

• Involving parents in classroom activities 

• Sharing responsibility with parents for academic performances of their children (e.g., 
parent/teacher or parent/school compact, etc.) 

Fast Response Survey on Education Reform, Teacher Survey, 1996 



While few surveys asked about school communication with communities, many surveys 
concentrated on schools’ communication with families. The item below asks school administrators 
about the information supplied to parents and the types of communication that occur between parents 
and staff. 

3. How often do the following forms of communication between parents and staff occur throughout your 

school? (response options range from always to never) 

• Parents are given written interim reports during grading periods. 

• Parents are requested to sign off on homework. 

• Parents have access to a school-sponsored "homework helpline” for information on 
assignments. 

• Parents are given written information about the goals and objectives of the schooPs regular 
instnictionai program. 

• Parents are given written information about the school’s overall performance on standardized 
tests. 

• Parents receive positive phone calls or notes fi'om teachers when their children’s performance 
improves at school. 

• Parents are given examples of work that meets high standards. 

• Parents are notified about children’s ability group placements. 



Fast Response Survey on Family and School Partnerships, 1996 



Items from two surveys-NAEP and Epstein School and Family Parmerships-collected 
information on volunteering in the schools, focusing on how volunteers are used. The item below 
solicits information from teachers on the classroom use of volunteers. 

3A. In my CLASSROOM, volunteers... 

• I do NOT use classroom volunteers 

• Listen to children read aloud 

• Read to the children 

• Grade papers 

• Tutor children in specific skills 

• Help on trips or at parties 

• Give talks (e.g., on careers, hobbies, etc.) 

School and Family Partnerships Teacher Questionnaire 

Few items attempt to learn about the critical two-way parmerships that schools are building 
with homes and co mmuni ties, which some researchers say are essential for ensuring that all smdents 
attain high academic standards. Only one item solicits information on the practice of school staff in 
conducting home visits (Appendix C5) and four items collect data on parent-school compacts 
(Appendix C5). These are the only attempts at documenting such two-way parmerships. Another 
item, shown below, collects data on schools’ interactions with community groups. 



Using a scale of 1 to 5 (1 =Characteristic of my school to 5 = Not important), please indicate the extent to which 
your school is involved in the following restructuring efforts. 

• School has formal mechanisms for coordinating with community agencies, for example, 
offering services dealing with child care, drug and alcohol abuse, and parental employment and 
training, etc. 

• School participates in an external mentoring program, such as, "I Have a Dream," which 
follows students for several years 

• School has formal arrangements with local employers to place students in career-ladder jobs 
during the school year, summers and following high school graduation 

• School has formal arrangements with institutions of higher education to assist students to 
continue their schooling 



Charting Reform, Principal Survey, 1994 



Finances and human resources development. We found no non-SASS items on reform of 
finance strategies or resource allocation to promote equity and equalization. 

Educational productivity. Most of the survey items addressing educational productivity focus 
on standards and smdent assessment (Appendix C7). Fewer items dealt with school accountability 
indicators (Appendix C7); none addressed rewards, sanctions, and competition to motivate 
achievement. 



Several of the items on standards assess teachers’ understanding of various standards, school 
support for the use of standards, and teachers’ use of standards in their instruction. Most of these 
items are not outcomes-oriented and do not address changes in student performance due to the 
presence or use of standards. The following items attempt to detect teachers’ awareness about certain 
standards and whether the use of standards is supported at various administrative levels. 



18. Please indicate how familiar you are with each of the documents listed below. (Have not heard of this, 
have heard of this) 

• NCTM Curriculum and Evaluation Standards; 

• California Mathematics Framework, etc. 

19. Now indicate your opinion about how well each statement applies to your school and district. (Strongly 
disagree, strongly agree, don’t know.) 

® The principal of this school is well-informed about one or more of these documents 

• There is a school-wide effort to achieve the kind of mathematics education promoted by one or 
more of these documents 

• Our district is providing extensive staff development based on one or more of these documents 

Survey of Elementary Mathematics Education in Calijbmia 

Two items from the Fast Response Teacher Survey on Education Reform also address 
standards use and other subthemes within educational productivity. The item from the teacher survey 
is shown below. 

3. The following are examples of some types of activities that are part of new or ongoing education reforms 
taking place in various parts of the country. For each, indicate in column A the extent to which you are 
implementing the activity in your classes (not at all to a great extent). In column B, check the three 
activities for which information is most needed. 

• Assisting ail students to achieve to high standards 

• Providing students or parents with examples of work that is successful in meeting high 
standards 

• Using authentic student assessments (e.g., portfolios) that measure performance tied to high 
standards 

• Using curricula tied to high standards 

• Using instructional strategies (e.g., hands-on activities, cooperative learning) tied to high 
standards 

• Using textbooks or other instructional materials tied to high standards 

• Using innovative technologies such as the Internet and telecommunications-supported instruction 

Fast Response Survey on Education R^orm, Teacher Survey, 1996 

The Fast Response Survey on Education Reform provides a list of definitions for some of the 
terms used in the survey, which helps ensure that respondents understand the terminology in the 
intended manner. Other terms, such as "authentic assessments," "performance-based assessment," or 



"portfolios" used in five items, were not defined and may not be commonly understood or have the 
same meaning to all respondents. 

Within productivity, many items query teachers about the types of assessments used. A 
sample item follows: 



How important are each of the following for you in judging how well students are learning? 

• Multiple-choice tests 

• Short-answer tests 

• Essay tests 

• Student work on open-ended problems 

• Portfolio of student work 

• Group projects 

• Individual projects 

• TAP (standardized achievement test) results 



Charting Reform, Tenth Grade Teacher Survey 



One interesting item investigates the principal’s perception of whether program decisions are 
aligned with assessment activities by analyzing the school use of student performance data: 



Please the extent to which your school is involved in the following resmicturing efforts. 

• School malfe-; program decisions based on systematic analysis of student performance data 

Charting Reform, Principal Survey 



We identified two items on school accountability indicators; one such item firom NAEP is 
shown below. 

16. Are results of district-wide or statewide standardized tests used throughout your school for public 
accountability and reporting (to parents, district, state, etc.)? 



National Assessment of Educational Progress 



We found no items on rewards, sanctions, and competition to motivate achievement. 



Technology. There are a large number of existing survey items on school and classroom use 
of technology, and many items address the area of improving instruction and opportunities (Appendix 
C8). The following is an exanqile of an item that attempts to document how computers are used in 
the classroom. 



22. During this school year, hov/ many times did you use computers in school in any of the following 
different ways? 

• learning something new 

• doing drills and practice 

• conducting laboratory experiments 

• writing/word processing 

• programming assignments 

• spreadsheet assignments 

• assignments to analyze data 

• taking tests 

• playing games 

• other 



Computers in Education Study, Student Survey 

We found few items that addressed continuing professional development in technology or 
organizing school operations (Appendix C8). We found no items that addressed the use of technology 
in school and district communication or establishing and maintaining program and student 
accountability. 



IV. S ummar y and Recommended Approach 



For this study, we reviewed the literature on education reform and identified eight elements of 
reform that directly affect schools and can potentially be measured by SASS: governance and 
organizational infrastructure; classroom instructional practices; professional development (of teachers); 
programs and educational services for varied populations; family and community partnerships; 
finances and h uman resource development; educational productivity; and technology (Appendix A). 

We then reviewed the 1993-94 SASS and over 25 additional large-scale survey instruments measuring 
components of reform (Appendix B) to identify potential survey items that could be used to document 
the status and evolution of these topics (Appendix C). In this section, we summarize our findings and 
offer recommendations on how SASS can collect data on the status and progress of education reform. 

SASS already measures some aspects of school reform. The largest number of items 
addressing reform are in governance and infrastructure, the delivery of professional development, and 
programs and services for varied populations. NCES-sponsored development work that has already 
occurred and other available large-scale survey instruments offer potential items to measure classroom 
instructional practices, dimensions of professional development among teachers, family and 
community parmerships, and a selection of topics within finance, educational productivity, and 
technology. 



While we identified numerous items in other large-scale surveys that measure some aspects of 
reform topics, many would need modification to measure school reform comprehensively. Items that 
address some reform subtopics are too narrowly focused or elicit perceptions instead of direct 
evidence of reform inq)lementation. Documenting school reform more fully requires additional 
developmental work such as expanding existing items and designing and pilot testing new items. 

Governance has become the major policy instrument of recent reforms, offering a wide array 
of proposals for modifying traditional policy making structures, school organizational arrangements, 
and professional roles and relationships. This is also the area with the largest number of existing 
SASS items on reform. For example, questions in the current SASS track policy makin g structures, 
school-based management, shared decision making, and teacher authority and autonomy, but there are 
aspects of each of these subtopics that are not measured. No items gather information on year-round 
schools, charter schools, vouchers, and schools within schools. Furthermore, no items generate 
information on how waivers, a key feature of the recent federal legislation, increase the flexibility of 
school programs and instructional options, especially in schools serving students at risk. Finally, no 
items address the influence of the courts on schools, although policy researchers anticipate the courts 
will continue to be a strong influence on education nationally, especially in matters related to the 
equitable distribution of state and local resources. 

The enacted classroom curriculum and teachers’ instructional approaches to help students 
become competent thinkers in core content areas can be indicators of school reforms. Previous NCES 
item development to measure classroom instructional practices and teachers’ professional development 
has resulted in draft items in these areas. The proposed instructional processes and professional 
development items will be piloted in 1997 (Mullens et al., 1996). 

The current SASS and other survey instruments include items for collecting basic information 
about programs and educational services for varied populations and family and co mmuni ty 
partnerships. These items, however, do not capture adequate information about the characteristics of 
before-and-after school programs, preschool and other early childhood education, and expanded health 
and human services for youth, families, and students at risk, among other educational services. They 
also do not generate information about the strategies schools use to prepare varied populations to 
achieve high academic standards within mains treamed classrooms. 

Although researchers suggest that helping all students attain high academic standards is 
strengthened by two-way partnerships between the school and the parents/community, available items 
primarily capture information about traditional connections between home and school such as parent 



conferences, panicipation at school meetings, and volunteering. Missing are items to document those 
parmerships and other new initiatives in parent education. 

Many schools and districts are rethinking their finance systems and initiating new strategies to 
identify, recruit, and con^jensate professional staff. SASS gathers interesting data on recruitment and 
compensation of teachers, but it could collect more on financing strucmres, taxation policies, and new 
mechanisms for distributing resources. 

There exist a rich set of questions about standards setting, testing, and teachers’ use of 
standards, but items do not capmre quality indicator information about the alignment of accountability 
policies, standards, and methods for assessing and reporting students’ achievement of harder content 
and thinking capacities. 

Upgrading available technology and applying technological tools to a wide array of 
management and instructional functions in schools is recognized as essential to achieving the national 
education goals. With few exceptions, however, available technology items collect information at 
such a fine level of detail that they may not be appropriate for a general K-12 survey. Moreover, 
they do not address the wide array of emerging technology applications to management, assessment, 
productivity analysis, classroom instruction, or professional development. 



Recommended Approach 

Although specific reforms are sometimes amorphous and difficult to define, education reform 
is big business and affects how schools, teachers, and smdents work. NCES needs to be in the 
forefront of data collection about school reform. We recommend a framework (Appendix A) for 
defining the central topics that reflect current reforms which most directly influence classroom 
instruction and student learnin g . They can be used to determine which items in SASS and other 
large-scale surveys can be used or modified to measure the progress of reform through SASS. 

We identified items from the 1993-94 SASS that could be used to measure school reform 
within the eight reform topics (Appendix C). Some SASS items that only touch on reform topics can 
be modified or extended to increase their utility to measure school reform; other items require 
substantial revision to reflect the language and structure of reform. 

Assessing the existence and the extent of school reform with a large-scale nationally 
representative survey is vital yet difficult. Researchers have discovered the trials of anticipating in 

33 



40 



BEST COPY AVAILABLE 



i 



the early stages which reforms will endure since some reforms are transitory, ill-defined, invisible, 
and create their own terminologies. Nevertheless, recent federal legislation has actively promoted 
innovation in state and local policy making to achieve systemwide improvements to the nation’s 
schools, and researchers and other educational policy analysts and advisors have encouraged NCES to 
document the resulting implementation and enduring effect of reforms. The next SASS provides a 
unique opportunity to monitor the effect of these major initiatives on conditions in classrooms, 
schools, and districts, and to create a nationally and state-representative data base from which 
policymakers, education officials, and researchers can identify and understand school reform in the 
United States. 
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APPENDIX A 



Conceptual Framework for Measuring School Reform 



Governance and Organizational Infrastructure: 

1.1 Policy making structures: changes in state, district, and local policy making 

organizations and arrangements; changes in policies 

1.11 State and local policy authority and coordination (e.g., roles of state and 
school boards) 

1.12 Regulation and deregulation through mandates and waivers (flexibility of 
rules) 

1.13 Centralization and decentralization of authority and decisions; shifting roles of 
principals, teachers, communities and their representative organizations 

1.14 State-based educational, political, and business alliances and "third-sector" 
organizations (quasi-govemmental entities) 

1.2 Organizational arrangements of schools 

1.21 Grade-level configurations: Traditionally graded configurations (elementary, 
junior/middle, high school); career/vocational centers/schools/components; 
community and "middle" colleges 

1.22 New choices in public school organizational arrangements: charter schools; 
specialized academies and magnet programs; schools- within-schools; year- 
round schools; charter schools 

1.23 Private schooling: home schooling 

1.3 Staffing and manag ing state and local education agencies and schools 

1.31 Management arrangements (goal and vision setting; supporting hierarchical vs. 
collaborative arrangements between districts and schools, between school 
managers and staff, between schools and communities; privatization, e.g. 
contracting for school management and instruction) 

1.32 Professional staffing/roles: Professional roles (new staff positions/roles, e.g. 
technology teachers; specialists for academic support and acceleration; 
assessment specialists; communications and community relations specialists) 
Mentors, team leaders; classroom aides; curriculum writers; health and family 
services professionals; bilingual and ESL teachers 

1.33 Paraprofessionals/paraprofessional staffing/roles: Technicians (office and 
classroom data entry and technology assistants); special education assistants 
Bilingual assistants; health and family services liaisons; recreation workers; 
before and after school assistants; health and safety assistants (cafeteria, bus, 
traffic) 
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1.4 Organizing uses of leaming/teaching time in schools (see also classroom instructional 
practices) 

1.41 Supplemental academic programs for students 

1.42 New calendar arrangements (longer school days; before and after school 
program courses and student assistance; longer school years) 

1.43 Flexibility of schedules for children and teachers within the school day 

1.44 Creating time for professional planning and within-school collaboration 

1.5 Institutional capacity building (for capacity building among teachers see Professional 
Development of Teachers) 

1.51 Tr aining opportunities for top managers and school boards 

1.52 Traineeships/mentoring 

1 .54 Networks and collaborations 

1.55 Continuing education through university and college staff development 
programs 

1.56 Technology to support organizational development, program analyses, and 
management decision making and 

1.6 Organizational influences of the courts 

1.61 Funding and allocation of resources 

1.62 Desegregation and equity 

1.63 Student achievement and assessment 

1.64 Private and parochial school programs 



Classroom Instructional Practices: Curriculum, Instruction, 
Instructional Resources (Mullens, 1995; Mullens & Leighton, 1996) 

2. 1 Conditions & (Learning) Context 

2.11 Course title 

2. 12 Class length and frequency 

2.13 Student grade level 

2. 14 Student ability (tracking) 

2. 15 Teacher influence 

2.16 Classroom context 

2.2 Course Content & Emphasis 

2.21 Topics 

2.22 Emphasis 

2.23 Student learning objectives 

2.24 Test items 

2.25 Integrated subjects 
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2.3 Instruction 

2.31 Teacher activity 

2.32 Student activity 

2.33 Lesson structure 

2.34 Student competencies 

2.35 Noninstructional time 

2.36 (Instructional technology; distance learning; innovative uses of computers for 
course taking, research, adaptive testing; other technological media) 

2.4 Materials 

2.41 Teacher materials 

2.42 Student materials 

2.43 Technology 

Professional Development of Teachers (Mullens, Leighton, LaGuarda, & 

O’Brien, 1996, September) 

3.1 Design (teacher voice in designing PD) 

3.2 Delivery (options, types, duration, resources) 

3.3 Content (subject, strategies, skills) 

3.4 Context (institutional support) 

3.5 Outcomes (teacher, instruction, school changes, smdent changes) 

Programs and Educational Services for Varied Populations 

4. 1 Services for smdents with special educational needs, learning disabilities, and learning 
abilities 

4.2 Services for limited-English speaking smdents 

4.3 Services for youth and families (school-linked health, social work, welfare, and 
community services; free and reduced-price lunches; counseling programs) 

4.4 Services for individual smdents in severe risk simations (substance abuse, 
homelessness, youth in the juvenile justice system) 

4.5 Cross-cultural programs to serve immigrant populations 

4.6 Supplementary educational and recreational services: Preschool and early childhood 
programs; before- and after-school care for children of working parents; recreation 
programs 

F amil y and Co mmuni ty Partnerships 

5.1 Parent education and skills development 

5.2 Communicating among families, schools, and communities 

5.3 Volunteering in schools 

5.4 Participating in decision making 

5.5 School, business, governmental, and community collaborations 
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Finances and Human Resources Development 



6. 1 State and local financing strategies; responses to legislative and judicial pressures 

6.2 Equity and equalization (through federal and state aid) 

6.3 Labor markets, recruitment, and compensation 



Educational Productivity 

7.1 Standards 

7.11 Content frameworks, standards, and course structures 

7.12 Aligning content and assessments: performance expectations and strategies for 
measuring student achievement 

7. 13 Defining goals and rigorous targets 

7.2 Student assessment and achievement 

7.21 Measuring individual student performance 

7.22 Classroom assessment 

7.23 District/school assessment 

7.3 School accountability indicators 

7.31 Performance reporting of school and district assessment results (test scores) 

7.32 Course taking 

7.33 Results on state and district assessments 

7.34 School completions and school leaving 

7.35 Attendance patterns (student and staff) 

7.36 Postsecondary education and emplo)mient 

7.37 Achievement gaps among ethnic and demographic groups 

7.4 Rewards, sanctions, and competition to motivate achievement 

7.41 Alternative high school diplomas (for students) 

7.42 Awards for teachers and schools (for school staffs) 

7.43 School takeovers and other strategies for reforming failing schools 

7.44 Intra- and interdistrict competition for students 



Te chn ology- This is a cross-cutting theme that both supports and promotes reform and 
changing instructional practices. Sustaining reform will be related, in part, to system capacity 
to bring technology into partnership with school organization, management, teaching/leaming, 
and evaluation structures. 

8.1 Developing and using technology-based information systems to support school and 
district management and communication 
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Improving instruction and opportunities for all children, including teachers’ use of 
technology in the classroom 
Continuing professional development 

Establishing and maintaining program and smdent accountability 

Organizing school operations, e.g., transportation systems, scheduling of smdents, 

courses, and staff 
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» 



List of 



Surveys and Abbreviations Used 









P 



P 



P 



CER Classroom Effects of Reform (Charting Reform) 

CER-T Elementary School Teacher Survey 

CER-10 Tenth Grade Teacher Survey 

CER-P Principal Survey 

CES Computers in Education Smdy (CompEd - lEA) 

CES-T Teacher Survey 

CES-CC Computer Consultant Survey 

CES-P Principal Survey 

CES-S Smdent Survey 

CRC Survey of Elementary Mathematics Education in California: Center for Research on the 

Context of Teaching 

FRSS-ER Fast Response Survey on Education Reform 

FRSS-ER-S School Survey 

FRSS-ER-T Teacher Survey 

FRSS-SFP Fast Response Survey on School and Family Parmerships 

FRSS-T Fast Response Survey on Telecommunications in U.S. Public Schools, K-12 

GPD Gilford Professional Development 

LSC Local Systemic Change, Pilot Surveys 

LSC-P Principal Survey 

LSC-S Science Teacher Survey 

LSC-M Math Teacher Survey 

NAEP National Assessment of Educational Progress 

NAEP-S School Characteristics and Policies Questionnaire 

NAEP-T Teacher Questionnaire 

NEA National Education Association, Stams of the American Public School Teacher, 

Sample Questionnaire 

NELS National Education Longimdinal Smdy, Teacher Questionnaire 

NHES National Household Education Survey, Parent Interview 
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56 



PROS 



PSA-CIP 

PSA-PD 

RUC 

SASS 



SFP 

TIMSS 



Prospects: The Congressionally Mandated Study of Educational Growth and Opportunity 
PROS-S Schools and Programs Survey 

PROS-P Principal Survey 

Policy Studies Associates, Classroom Instructional Practices 

Policy Studies Associates, Professional Development 

Reform Up Close 

Schools and Staffing Survey 

SASS- 1 A Teacher Demand and Shortage Questionnaire 
for Public School Districts 

SASS-2A Public School Principal Questionnaire 

SASS-2B Private School Principal Questionnaire 

SASS-3A Public School Questionnaire 

SASS-3B Private School Questionnaire 

SASS-4A Public School Teacher Questionnaire 

SASS-4B Private School Teacher Questionnaire 

LS-IA Public School Library Media Center Questionnaire 

LS-2A Public School Library Media Specialist/Librarian Questionnaire 

School and Family Parmerships (Joyce Epstein) 

Third International Mathematics and Science Study 
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SASS and Large-Scale Surveys: Number of Items on School Reform 



ISSUES 


SASS 


Other 

Surveys 


1. Gk)vemance and Organizational Infrastructure 






1 . 1 Policymaking strucmres 


7 


17 


1.2 Organizational arrangements of schools 


9 


4 


1.3 Staffing and managing state and local education agencies and 


2 


9 


schools 






1.4 Organizing uses of leaming/teaching time in schools 


4 


10 


1.5 Building and sustaining organizational capacity to respond flexibly 


3 


1 


to social and organizational changes 






1.6 Organizational influences of the courts 


0 


0 


2. Classroom Instructional Practices 






2. 1 Conditions and Learning Context 


0 


2 


2.2 Course Content and Emphasis 


3 


2 


2.3 Instruction 


0 


3 


2.4 Materials 


6 


1 


3. Professional Development of Teachers 






3.1 Design 


2 


2 


3.2 Delivery 


5 


3 


3.3 Content 


2 


2 


3.4 Context 


1 


5 


3.5 Outcomes 


1 


1 


4. Programs and Educational Services for Varied Populations 






Cross-cutting items 


1 


2 


4.1 Services for smdents with special educational needs, learning 


2 


0 


disabilities, and learning abilities 






4.2 Services for limited-English speaking smdents 


2 


3 


4.3 Services for youth and families 


1 


0 



1 



APPENDIX B3 



ISSUES 


SASS 


Other 

Surveys 


4.4 Services for individual students in severe risk situations 


2 


1 


4.5 Cross-cultural programs to serve immigrant populations 


0 


0 


4.6 Supplementary educational and recreational services 


0 


2 


5. Family and Community Partnerships 






Cross-cutting items 


0 


14 


5.1 Parent education and skills development 


1 


3 


5.2 Communicating among families, schools, and communities 


3 


30 


5.3 Volunteering in schools 


1 


6 


5.4 Participating in decision making 


2 


4 


5.5 School, business, governmental, and community collaborations 


0 


2 


6. Finances and Human Resources Development 






6.1 Finance strategies 


0 


0 


6.2 Equity and equalization 


0 


0 


6.3 Labor markets, recruitment, and compensation 


10 


0 


7. Educational Productivity 






Cross-cutting items 


0 


2 


7.1 Standards 


2 


15 


7.2 Student assessment and achievement 


0 


19 


7.3 School accountability indicators 


1 


3 


7.4 Rewards, sanctions, and competition to motivate achievement 


0 


0 


8. Technology 






8.1 Developing and using technology-based information systems to 


0 


0 


support school and district management and communication 






8.2 Improving instruction and opportunities for all children, including 


1 


36 


teachers’ use of technology in the classroom 






8.3 Continuing professional development 


1 


1 


8.4 Establishing and maintaining program and student accountability 


0 


0 


8.5 Organizing school operations 


0 


1 
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• Is strongly committed to shared decision making 
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NHES PD3,4,5 • Is (your child’s school) a regularly assigned school or a school dial you chose? 

• Is die school church-related or not church-related? 

• Is it a Catholic school? 
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NAEP-T 3D Do you have paid aides in your classroom? How many? 
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SFP TQ Q-6 How important is each of these for you to conduct at your grade level 

• Have a conference with each of my student’s parents at least once a year 

• Attend evening meetings, performances, and workshops at my school 

• Contact parents about tlieir children’s problems or failures 

• Inform parents when their children do something well or improve 
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5.4 Including parents in decisionMnaking structures 
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• National Council of Teachers of Mathematics (NCTM) Professional Standardss for Teaching Mathematics 

• State Education Department Curriculum Guide 

• School District Curriculum Guide 
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Census Mapping Project/School District Data Book 

Cognitive Research on the Teacher Listing Form for 
the Schools and Staffing Survey 

The Schools and Staffing Survey (SASS) for 1998-99: 
Design Recommendations to Inform Broad Education 
Policy 

Should SASS Measure Instructional Processes and 
Teacher Effectiveness? 

How Accurate are Teacher Judgments of Students' 
Academic Performance? 

Making Data Relevant for Policy Discussions: 
Redesigning the School Administrator Questionnaire 
for the 1998-99 SASS 

1998-99 Schools and Staffing Survey: Issues Related to 
Survey Depth 

Towards an Organizational Database on America's 
Schools: A Proposal for the Future of SASS, with 
comments on School Reform, Governance, and Finance 

Predictors of Retention, Transfer, and Attrition of 
Special and General Education Teachers: Data from the 
1989 Teacher Followup Survey 

Estimation of Response Bias in the NHES:95 Adult 
Education Survey 

The 1995 National Household Education Survey: 
Reinterview Results for the Adult Education 
Component 



Contact 
Dan Kasprzyk 

Jeffiey Owings 

Tai Phan 
Dan Kasprzyk 

Dan Kasprzyk 

Dan Kasprzyk 
Jerry West 
Dan Kasprzyk 

Dan Kasprzyk 
Dan Kasprzyk 

Dan Kasprzyk 

Steven Kaufinan 
Steven Kaufinan 



Listing of NCES Working Papers to Date-Continued 



Number 


Title 


Contact 


96-15 (June) 


Nested Structures: District-Level Data in the Schools 
and Staffing Survey 


Dan Kasprzyk 


96-16 (June) 


Strategies for Collecting Finance Data from Private 
Schools 


Stephen 

Broughman 


96-17 (July) 


National Postsecondary Student Aid Study: 1996 Field 
Test Methodology Report 


Andrew G. 
Malizio 


96-18 (Aug.) 


Assessment of Social Competence, Adaptive 
Behaviors, and Approaches to Learning with Young 
Children 


Jerry West 


96-19 (Oct.) 


Assessment and Analysis of School-Level 
Expenditures 


William Fowler 


96-20 (Oct.) 


1991 National Household Education Survey 
(NHES:91) Questioimaires: Screener, Early Childhood 
Education, and Adult Education 


Kathryn Chandler 


96-21 (Oct.) 


1993 National Household Education Survey 
(NHES:93) Questioimaires: Screener, School 
Readiness, and School Safety and Discipline 


Kathryn Chandler 


96-22 (Oct.) 


1995 National Household Education Survey 
(NHES:95) Questioimaires: Screener, Early Childhood 
Program Participation, and Adult Education 


Kathryn Chandler 


96-23 (Oct.) 


Linking Student Data to SASS: Why, When, How 


Dan Kasprzyk 


96-24 (Oct.) 


National Assessments of Teacher Quality 


Dan Kasprzyk 


96-25 (Oct.) 


Measures of Inservice Professional Development: 
Suggested Items for the 1998-1999 Schools and 
Staffing Survey 


Dan Kasprzyk 


96-26 (Nov.) 


Improving the Coverage of Private Elementary- 
Secondary Schools 


Steven Kaufrnan 


96-27 (Nov.) 


Intersurvey Consistency in NCES Private School 
Surveys for 1993-94 


Steven Kaufrnan 
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Number 


Title 


Contact 


96-28 (Nov.) 


Student Learning, Teaching Quality, and Professional 
Development: Theoretical Linkages, Current 
Measurement, and Recommendations for Future Data 
Collection 


Mary Rollefson 


96-29 (Nov.) 


Undercoverage Bias in Estimates of Characteristics of 
Adults and 0- to 2- Year-Olds in the 1995 National 
Household Education Survey (NHES:95) 


Kathryn Chandler 


96-30 (Dec.) 


Comparison of Estimates from the 1995 National 
Household Education Survey (NHES:95) 


Kathryn Chandler 


97-01 (Feb.) 


Selected Papers on Education Surveys: Papers 
Presented at the 1996 Meeting of the American 
Statistical Association 


Dan Kasprzyk 


97-02 (Feb.) 


Telephone Coverage Bias and Recorded Interviews in 
the 1993 National Household Education Survey 
(NHES:93) 


Kathryn Chandler 


97-03 (Feb.) 


1991 and 1995 National Household Education Survey 
Questionnaires: NHES:91 Screener, NHES:91 Adult 
Education, NHES:95 Basic Screener, and NHES:95 
Adult Education 


Kathryn Chandler 


97-04 (Feb.) 


Design, Data Collection, Monitoring, Interview 
Administration Time, and Data Editing in the 1993 
National Household Education Survey (NHES:93) 


Kathryn Chandler 


97-05 (Feb.) 


Unit and Item Response, Weighting, and Imputation 
Procedures in the 1993 National Household Education 
Survey (NHES:93) 


Kathryn Chandler 


97-06 (Feb.) 


Unit and Item Response, Weighting, and Imputation 
Procedures in the 1995 National Household Education 
Survey (NHES:95) 


Kathryn Chandler 


97-07 (Mar.) 


The Determinants of Per-Pupil Expenditures in Private 
Elementary and Secondary Schools: An Exploratory 
Analysis 


Stephen 

Broughman 


97-08 (Mar.) 


Design, Data Collection, Interview Timing, and Data 
Editing in the 1995 National Household Education 
Survey 


Kathryn Chandler 



Listing of NCES Working Papers to Date— Continued 



Number 
97-09 (Apr.) 

97-10 (Apr.) 

97-11 (Apr.) 
97-12 (Apr.) 



Title 

Status of Data on Crime and Violence in Schools: Final 
Report 

Report of Cognitive Research on the Public and Private 
School Teacher Questionnaires for the Schools and 
Staffing Survey 1993-94 School Year 

International Comparisons of Inservice Professional 
Development 

Measuring School Reform: Recommendations for 
Future SASS Data Collection 



Contact 
Lee Hofhnan 

Dan Kasprzyk 

Mary Rollefson 
Mary Rollefson 
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